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Bayesian  Estimation  in  the  One-Parameter 
Latent  Trait  Model1*2 


INTRODUCTION 

In  recent  years  there  has  been  considerable  interest  among  measurement 
theorists  and  practitioners  in  latent  trait  theory  since  it  offers  the 
potential  for  improving  educational  and  psychological  measurement  practices. 
However,  before  latent  trait  theory  can  be  successfully  applied  to  solve 
existing  measurement  problems,  the  problem  of  estimating  parameters  in 
latent  trait  models  has  to  be  addressed. 

The  literature  in  latent  trait  theory  abounds  with  procedures  for  the 
estimation  of  parameters.  The  estimation  procedures  that  have  been  devel¬ 
oped  over  the  past  thirty  years  range  from  heuristic  procedures  such  as 
those  given  by  Urry  (1974)  and  Jensema  (1976)  to  conditional  as  well  as 
unconditional  maximum  likelihood  procedures  (Andersen,  1970,  1972,  1973a, 
1973b;  Bock,  1972;  Lord,  1968,  1974;  Samejima,  1969,  1972;  Wright  & 
Panchapakesan ,  1969;  Wright  &  Douglas,  1977).  With  the  exception  of  the 
"conditional"  maximum  likelihood  procedure  provided  by  Andersen  (1970) 
for  the  one-parameter  model,  the  maximum  likelihood  estimators  of  the 
parameters  in  the  latent  trait  models  are  less  than  optional  as  a  result 

1The  research  reported  here  was  performed  pursuant  to  Grant  No. 
N0014-79-C-0039  with  the  Office  of  Naval  Research  and  to  Grant  No. 

FQ  7624-79-0014  with  the  Air  Force  Human  Resources  Laboratory.  The 
opinions  expressed  here,  however,  do  not  reflect  the  positions  or  poli¬ 
cies  of  these  agencies. 

2 The  author  is  grateful  to  the  encouragement  and  support  provided 
by  Dr.  Malcolm  Ree  of  the  Air  Force  Human  Resources  Laboratory,  and  to 
Dr.  Charles  Davis  of  the  Office  of  Naval  Research. 
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of  the  problem  of  estimating  "structural  parameters"  In  the  presence  of 
"Incidental  parameters"  (Andersen,  1970;  Zellner,  1971,  pp.  114-154). 

The  "structural  parameters"  In  latent  trait  models  are  the  item  parameters 
while  the  "incidental  parameters"  are  the  ability  parameters  since  these 
increase  without  bound  as  the  number  of  examinees  is  increased  to  pro¬ 
vide  stable  estimates  of  the  parameters.  Furthermore,  as  Novick,  Lewis, 
and  Jackson  (1973)  have  remarked,  "in  the  estimation  of  many  parameters 
some,  by  chance,  can  be  expected  to  be  substantially  overestimated  and  the 
others  substantially  underestimated." 

When  several  parameters  have  to  be  estimated  simultaneously,  and 
when,  as  in  the  present  case,  both  structural  and  incidental  parameters 
have  to  be  estimated,  a  Bayesian  solution  to  the  estimation  problem  may 
be  appropriate  (Zellner,  1971,  pp.  114-119).  This  is  particularly  true 
if  prior  information  or  belief  about  the  parameters  is  available,  since 
in  this  case,  the  incorporation  of  this  information  will  certainly  increase 
the  "accuracy"  or  the  meaningfulness  of  the  estimates.  An  example  of 
this  was  encountered  by  Lord  (1968) ,  where  in  order  to  prevent  estimates  of 
the  item  discrimination  parameter  from  drifting  out  of  bounds,  it  was 
necessary  to  Impose  limits  on  the  range  of  values  the  parameter  could 
take.  Although  the  estimation  procedure  employed  by  Lord  (1968)  was  not 
Bayesian,  this  illustrates  the  role  of  prior  information  in  obtaining 
meaningful  estimates.  A  further  argument  that  can  be  advanced  in 
favor  of  a  Bayesian  approach  is  that  the  logic  of  the  Bayesian  infer¬ 
ential  procedure  is  more  appealing  than  the  classical,  sampling  theoretic, 
inferential  procedure.  As  Zellner  (1971,  p.  362)  has  pointed  out, 

"...there  is  no  need  to  justify  inference  procedures  in  terms  of  their 
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behavior  in  repeated,  as  yet  unobserved , 1  samples  as  is  usually  done  in  the 
sampling  theory  approach*"  Consequently,  it  is  possible  to  make  proba¬ 
bilistic  statements  about  the  parameters  themselves,  based  on  the  infor¬ 
mation  that  is  available. 


Bayesian  Procedures 

It  may  be  instructive  to  review  briefly  the  Bayesian  estimation 
procedure.  Let  p 0^)  denote  the  joint  probability  density  function  (pdf) 
for  a  random  observation  vector  £  and  a  parameter  vector  6_,  also  random. 
Then, 

p(X,  £)  “  P(ili)  p(£) 

“  P<ilz>  P<Z> 

where 

p(0_|y)  -  p(0.)  p(xl£)/p(z.) 

or, 

(l]  p(£lz)  *  p(£)  p(zl®) 

since  p(^)  1*  0  is  a  constant.  Equation  [1]  is  the  essence  of  Bayes' 
Theorem  and  is  of  primary  Importance  in  the  estimation  of  parameters 
and  for  drawing  inferences  concerning  the  parameters.  The  probability 
density  function  p(9ji)  is  the  posterior  pdf  for  the  parameter  vector  6_, 
given  the  sample  information  or  data,  and  p(0_)  is  the  prior  pdf  for  the 
vector  £.  The  quantity  p(i|£)  is  a  proper  pdf  as  long  as  £  is  a  random 
variable.  However,  the  moment  the  vector  is  realized,  p (yj  0)  ceases 

*The  italics  have  been  provided  by  the  authors. 
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to  have  the  interpretation  as  a  pdf.  In  this  case,  p(xl£)  is  strictly  a 
mathematical  function  of  £,  well  known  as  the  likelihood  function . 

Since  the  notation  p(il 0)  can  be  mistaken  for  a  pdf,  the  likelihood 
function  is  often  written  as  L(zl£) ,  and  sometimes,  to  emphasize  the 
fact  that  it  is  a  function  of  £,  as  L(£|i).  Thus,  the  expression  given 
in  [1]  can  be  written  as 

[2]  p(£|y)  *  L(£|jO  p(£)  . 

It  is  interesting  to  note  that  if  p(£)  is  assumed  to  be  a  constant, 
i.e.,  the  prior  belief  about  £  is  summarized  via  a  uniform  distribution, 
the  posterior  pdf  of  £  is  proportional  to  the  likelihood  function.  In  a 
sense,  this  interpretation  constitutes  a  Bayesian  justification  of 
maximum  likelihood  principle. 

Once  the  prior  belief  about  the  parameter  £  is  specified,  the  joint 
posterior  pdf  of  the  vector  £  given  the  data  can  be  readily  obtained.  The 
posterior  pdf  of  £  contains  all  the  information  necessary  for  drawing 
inferences  concerning  £  (jointly  or  individually)  and  for  obtaining  esti- 
mtes  of  £  once  a  "loss  function"  is  prescribed.  For  instance,  if  a  squared- 
error  loss  function  is  deemed  appropriate,  then  the  mean  of  the  posterior 
pdf  of  £  can  be  taken  as  the  estimator  of  £.  On  the  other  hand,  if  a 
zero-one  loss  function  is  appropriate,  then,  the  mode  of  the  posterior 
pdf  of  £  is  the  estimator  of  £.  Similarly,  for  the  absolute  deviation 
loss  function,  the  median  of  the  posterior  pdf  of  £  is  the  appropriate 
estimator. 

The  Bayesian  procedure  described  above  has  been  successfully  applied 
in  a  variety  of  situations.  For  a  sampling  of  these  applications  the 
reader  is  referred  to  Novick  and  Jackson  (1974) ,  and  Zellner  (1971) . 
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However,  Bayesian  methods  have  found  only  a  limited  application  in  the 
area  of  latent  trait  theory.  Birnbaum  (1969)  obtained  Bayes  estimates  of 
the  ability  parameter  in  the  one-  and  two-parameter  logistic  models  under 
the  assumption  that  the  item  parameters  were  known.  He  chose,  for  mathe¬ 
matical  tractability,  the  prior  pdf  of  0£,  the  ability  of  the  ith 
examinee,  to  be  the  logistic  density  function,  i.e. 

p(6i)  *  exp  (-D8 1) / [ 1+exp (-D0 1) ] 2 

where  D=1.7  is  a  scaling  factor.  Owen  (1975),  in  applying  the  latent 
trait  model  in  an  adaptive  testing  context,  obtained  Bayes  estimates  of 
ability,  Bj,  under  the  assumption  that  the  prior  pdf  of  0^  was  normal 
with  mean,  zero,  and  variance,  unity. 

The  Bayesian  procedure  suggested  by  Birnbaum  (1969)  and  Owen  (1975) 
require  rather  exact  specification  of  prior  belief.1  An  alternative  and 
a  more  powerful  procedure  has  been  suggested  by  Lindley  (1971) .  He  has 
shown  that  if  tue  information  that  is  available  can  be  considered  exchange¬ 
able,  then  a  hierarchical  Bayesian  model  can  be  effectively  employed  for 
the  estimation  of  parameters. 

In  order  to  illustrate  the  hierarchical  model,  let  us  consider 
the  problem  of  estimating,  say,  the  ability  0^  of  an  individual  (1*1,  ...,  N) . 
If  it  can  be  assumed,  apriori,  that  exchangeability  holds,  i.e.,  the 
information  about  0^  is  no  different  from  the  information  about  any  other 
9 j ,  observed  or  yet  to  be  observed,  then,  0^  can  be  assumed  to  be  a  random 
sample  from  some  distribution,  p(0).  For  convenience,  if  p(0)  is  taken 

Meredith  and  Keames  (1973)  and  Sanathanan  and  Blumenthal  (1978) 
have  obtained  empirical  Bayes  estimators  of  the  ability  parameters  for 
the  one-parameter  model.  In  these  procedures  the  prior  pdf  is  estimated 
from  the  data. 
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to  be  normal  with  mean  ii  and  variance  o2,  then  this  would  constitute 
specification  of  the  first  stage  of  the  hierarchical  model.  Since  p 
and  a2  are  unknown,  specifying  prior  beliefs  on  these  "hyperparameters" 
would  constitute  the  second  stage  of  the  hierarchical  model.  Usually, 
the  hyperparameter  distributions  are  specified  in  such  a  way  that  they 
depend  upon  constants  which  can  be  determined  from  the  prior  belief  the 
investigator  has  about  the  parameters,  and  hence  the  hierarchical  model 
terminates  at  the  second  stage.  With  this  two  stage  model,  it  is  possible 
to  estimate  8^  (i=l,  ...»  N)  without  any  reference  to  the  nuisance  param¬ 
eters,  p  and  a2. 

Novick  (1971)  has  described  this  hierarchical  model  as  an  analog  of 
the  empirical  Bayes  procedure  advocated  by  Robbins  (1955)  and  the  simul¬ 
taneous  estimation  procedure  provided  by  Stein  (1962).  Furthermore,  as 
Novick,  Lewis,  and  Jackson  (1973)  have  pointed  out,  this  procedure  not 
only  employs  the  direct  information  gained  through  the  observation  of 
an  individual,  but  also  the  collateral  information  contained  in  observations 
from  other  individuals.  They  further  note  that,  "In  effect,  this  collateral 
information  is  used  to  provide  ’prior'  information  for  the  estimation.... 
Thus  to  some  extent,  the  problem  of  selecting  prior  distributions  for 
Bayesian  analyses  is  neutralized,  and  this  is  effected  from  a  strictly 
Bayesian  approach." 

The  hierarchical  Bayesian  model  has  been  successfully  employed  by 
Lindley  and  Smith  (1972),  Novick  et  al.  (1973),  and  Zellner  (1971),  to 
name  a  few.  However,  this  approach  has  not  been  employed  for  estimating 
parameters  in  latent  trait  models.  The  purpose  of  this  paper,  hence,  is 
to  provide  a  Bayesian  estimation  procedure,  in  the  sense  of  Lindley,  for 
estimating  parameters  in  the  one-parameter  latent  trait  model. 


Bayesian  Estimation  in  the  One-Parameter  Logistic  Model 

The  Model 

Let  Xjj  denote  a  random  variable  that  represents  the  binary  response 

of  an  examinee  i  (i»l,  ....  N)  on  item  j  (j-1 . n).  If  the  examinee 

responds  correctly  to  the  item,Xij=l,  while  for  an  incorrect  response, 
Xij=0.  We  assume  that  the  complete  latent  space  is  unidimensional,  and 
that  the  probability,  P[X^j“l],  that  an  individual  with  ability  parameter 
0^  will  correctly  respond  to  an  item  with  difficulty  parameter,  b j ,  is 
given  by  the  logistic  model, 

[3]  PtX-y-llaj;]  =  exp(ei-bj)/{l+exp(6i-bj)}. 

On  the  other  hand,  the  probability  that  the  individual  will  respond 
incorrectly  is  given  by 

[4]  PlXij-01%]  *  1  -  PtXy-ll^ 

*  l/d+expCe^-bj)}  . 

The  probabilities  given  in  Equations  [3]  and  [4]  can  be  combined  to  yield 

[5]  pIxij  “  xij  I®l]  “  exp{x^j  (0j-bj) }/{l+exp(9j-bj)  } 

where  x^j*l  for  a  correct  response  and  Xij=*0  for  an  incorrect  response. 

The  above  model,  since  it  depends  only  on  one  item  parameter, 
difficulty,  is  commonly  known  as  the  Rasch  model  or  the  one-parameter 
logistic  model.  For  a  detailed  description  of  this  model  and  its  prop¬ 
erties,  the  reader  is  referred  to  Wright  (1977). 
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Conditional  Estimation  of  Ability 

In  some  situations  it  may  be  of  interest  to  estimate  the  ability  0^ 
of  an  examinee  who  takes  a  test  which  has  been  calibrated,  i.e.,  the 
difficulty  parameters  are  known.  Moreover,  since  the  problem  of  esti¬ 
mating  ability  when  the  item  parameters  are  known  is  simpler  to  deal 
with  and  provides  an  illustration  of  the  basic  ideas  involved,  this  case 
will  be  dealt  with  in  detail  first. 

The  model  given  by  Equation  [5],  should  in  the  strict  sense  be 
expressed  as 


[6]  plxij  =  xijl6i»bjl  =  exp{xij(6i-bj)}/{l+exp(ei-bj)}  . 


Although  there  are  several  ways  to  write  the  model,  the  expression  given 
by  [6]  is  the  most  convenient  for  the  present  situation. 

It  follows,  from  the  principle  of  local  independence,  that  the 
joint  probability  of  responses  of  the  N  examinees  on  n  items  is  given  by 


[7] 


P  [^i  ^  2”x12  9  *  *  *  >^ij”xij  >*"  *  ^Nn^Nn  *  &2  1 


,bnl 


N  n 

=  n  n  exp{x^j (0 j-bj) }/{l+exp(6j-bj ) }  . 

i=l  j“l 


Once  the  responses  of  the  N  examinees  on  the  n  items  are  observed,  the 
above  expression  ceases  to  have  the  probability  interpretation  and  becomes 
the  likelihood  function,  L(X  *  x|0_,  k)  •  Upon  simplification, 

[8]  L(x=xl£»b)  =  exp{£  I  Xjj  (0^-b.)  }/n  II{(l+esp'o'1-i-)j)} 

i  j  J  J  J 

■  exp{£  r^  -  l  qjb j  > /n  n{(l+exp(ei-bj)} 
where  ri  =  I  xi j »  an<*  <lj  ■  7  x^j  .  Since  the  item  parameters  are 
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known  constants,  the  likelihood  function  is  strictly  a  function  of  6_ 
and,  hence,  can  be  expressed  as 

[9]  L(x|e_,  b)  «  exp{£  r^l/11  iHl+expOi-b.,)}  . 

i 

Returning  to  Equation  [1],  we  see  that  in  order  to  obtain  the 
posterior  density  function  of  9^  given  the  observations  and  the  item 
parameters,  it  is  necessary  to  specify  the  prior  distribution  of  6_.  To 
this  end,  in  the  first  stage  of  the  hierarchical  model,  we  assume  that, 
apriorl,  the  ability  parameters,  0^,  are  independently  and  identically 
normally  distributed,  i.e., 

[10]  eju,*  *  N(p,$). 

The  assumption  that  the  thetas  are  independently  and  identically  distri¬ 
buted  follows  from  the  assumption  of  exchangeable  prior  information  about 
the  thetas.  The  assumption  of  normality  also  appears  to  be  reasonable 
and  has  been  made  by  numerous  authors,  e.g. ,  Lord  and  Novick  (1968). 

In  order  to  complete  the  hierarchical  Bayesian  model,  we  have  to 
specify  prior  distributions  for  p  and  This  is  the  second  stage.  At 
this  level,  we  assume  that,  apriorl,  P  and  $  are  independently  distributed, 
and  that  P  has  the  uniform  distribution.  Thus, 

[11]  p(p,<J>)  »  p(<l>). 

The  uniform  distribution  is  not  a  proper  distribution,  although  this 
choice  can  be  justified  to  some  extent  (Zellner,  1971,  pp.  41-43).  It 
may,  however,  be  more  appropriate  to  specify  a  "non-dif fuse"  prior  and 
this  possibility  will  be  explored  further  in  a  later  paper. 
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It  now  remains  to  specify  the  form  of  p($).  Since  $  is  the 


variance  of  0^,  $  can  be  assumed  to  have  the  inverse  chi-square,  x-2 

distribution,  i.e.. 


[12] 


-(^+1) 

P($|v,  s2)  *  <t> 


exp(-vs2/2$). 


The  quantities  v  and  s2  are  parameters  of  the  inverse  chi-square  dis¬ 
tribution,  and  have  to  be  specified  apriori.  The  inverse  chi-square 
distribution  can  be  expressed  in  different  ways.  Novicfc  and  Jackson 
(1974)  prefer  the  form 

-(tS+D 

p(<j>|v,  X)  <*  <J>  exp(-A/2$) . 


For  this  form,  the  mean  of  the  distribution  is  A/(v-2)  and  the  mode  is 
A/(v+2).  For  the  form  given  by  Equation  [12]  the  mean  is  s2v/(v-2)  and 
the  mode  is  s2v/ (v+2) ,  with  both  mean  and  mode  approaching  s2  as  v 
increases.  These  two  forms  are  clearly  equivalent,  but  the  form  given 
by  Equation  [12]  is  employed  in  the  sequel  because  it  provides  a  direct 
interpretation  of  the  parameter  v  and  s2.  The  quantity  s2  thus  represents 
the  investigator’s  belief  about  the  "typical"  value  of  the  parameter  <j> 
while  v  represents  his/her  degree  of  confidence. 

The  joint  posterior  distribution  of  6/  ■  [0j,  02,  •••»  6N]  given 
b  and  the  item  responses  is  given  by 

[13]  P(i|b»x)  «  L(x|^,b)  pC©.|p,^)p(y»4>)  • 

The  likelihood  function  L(x|£,y  is  given  by  Equation  [9],  p(v,$)  by 
Equation  [12],  and 


’1 

j 

-ii-  ! 

N  , 

[1A]  p(0|p,<|>)  -  ^  i*  exp{-  i  (01-u)2/4>} 

_  £  N 

*  <f>  2  exp{-  £  (0  .-y)2/2<^> 

i-1  x 

Combining  the )e  expressions,  we  have, 

[15]  p(0jb,x,p,<j>,v,  s2)  «  [exp{£  r . 6 .  }/H  n  {l+exp(0.-b  )}] 

i  i  j  3 

-  N  -(>1)  \ 

[$  7  exp  {-  £(6.-u)ty2<f>}]  [4>  exp(-vs2/2<|>)  ]  ; 

i  1 

1 

The  above  expression  depends  upon  the  "nuisance"  parameters  p  and  <{>  and  f 

I 

hence  these  have  to  be  integrated  out.  Since  ^(0^-p)2  *  ^(O^-O)2  +  N(0.-p)2,  i 

and  | 

OO 

[m  exp  ~{N(6. -v)  2/24>}dy  «  (J)*5  ,  I 

j 

integration  with  respect  to  p  yields  ] 

i 

* 

[16]  pd|_b,x,((!,v,s2)  «  L(x!l.b)  <J'_^N+V+1^2  expf-Cvs^COj-O. ) 2 >/2<J>]  #  j 

Noting  that  j 

1 

oo  j 

/  <p  m  exp(-k/<p)d<t>  <*  3 

-o 

and  integrating  with  respect  to  $,  we  obtain 

[17]  p(0|b,x,v,s2)  «  L(x|  0,b)  (vs2  +  ^(0  -0  )2}"^N+V”1^2 

±  i  • 

*  [exp{£  1^0.}/  n  n{l+exp(0.-b.)}] 

i  1  ij  3 

•{vs2  +  l  (0.-0  )2}~0«-v-l)/2  : 

1  i 


[18] 
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i 


The  joint  posterior  modes  are  obtained  by  differentiating  log 
p(djb^x)  with  respect  to  _0,  setting  these  derivatives  equal  to  zero, 
and  solving  the  resulting  equations: 
n 

[19]  l  =  r.  -  (0.-0  )/a2  (i=l . N) 

j„l  «  i  i  • 

where 

P^  ”  exp(6i-bj)/{l+exp(0i-bj)} 


and 


N 

o2  =  {vs2  +  £  (0.-0  )2}/(v+N-1) 

i-1 


Since  this  system  of  equations  is  non-linear,  numerical  procedures  have 
to  be  employed.  The  Newton-Raphson  iterative  procedure  is  ideally  suited 
for  this  situation.  Let 

n 

[20]  f(0.)  -  l  P..  +  (0.-0  )/a2  -  r.  . 

j«l  J  ' 


Then 


[21]  f'(6i)  -  l  P^d-P^)  +  (a2(l-l)  -  2(01-0>)/(v+N-l)}/(a2)2. 

If  0^  is  the  value  of  0^  at  the  kth  iteration,  then  ejk+1^  is  given  by 


[22]  0^k+1)*  0<k)  -  f(0^k))/f'(0jk)). 


with  0^°),  the  starting  value  being  given  by  (Wright  &  Douglas,  1977), 

[23]  0^o)  -  b#  +  (l+s2/2.89}log(r1/n-r1) 

where 

b.  “  Ibj/n,  and  s£  -  Z ^b j— b . ) 2 / <n— 1)  . 
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Although  the  iterative  scheme  given  in  [22]  is  for  estimating  the 
ability  0^  for  each  individual,  in  reality,  only  the  ability  correspond¬ 
ing  to  each  raw  score  r  (r»l,  ....  n-1)  need  be  estimated.  The  ability 
corresponding  to  raw  score  r=0  and  r»n  cannot  be  estimated  by  virtue  of 
[23].  Hence,  individuals  who  obtain  perfect  score  or  zero  score  are 
eliminated  from  the  analysis.  It  should  also  be  pointed  out  the  Newton- 
Raphson  scheme  given  above  is  not  the  vector  version  of  the  procedure 
since  for  this  procedure  the  matrix  of  derivatives  {af/ae^ae^}  has  to 
be  computed  and  inverted.  The  procedure  described  here  worked  sufficiently 
well,  converging  in  as  few  as  three  to  four  iterations. 

Joint  Estimation  of  Item  and  Ability  Parameters 

The  case  considered  above,  where  the  item  parameters  were  assumed 
to  be  known,  provides  the  necessary  background  for  the  Bayesian  estima¬ 
tion  procedure.  However,  this  situation  may  not  be  realistic  and, 
hence,  it  is  necessary  to  develop  a  procedure  for  the  joint  estimation 
of  the  item  and  ability  parameters. 

We  proceed  in  the  manner  indicated  for  the  case  of  known  item 
parameters.  Hence,  in  addition  to  making  the  assumptions  about  the 
ability  parameters,  we  have  to  make  assumptions  regarding  the  item  param¬ 
eters.  Again,  as  in  the  previous  case,  we  specify  prior  beliefs  about 
the  parameters  in  two  stages.  In  the  first  stage,  for  the  model  given 
in  [5],  we  assume: 

[24a]  eJPe^e  *  H(ve,V»  (1"1»  ••••  N) 


[24b]  bj|ub,<j>b  'v-  N(yb,$b). 


( ,  •  •  • » 


n) 


In  addition,  we  assume  that,  apriorl,  0^  and  are  independent,  6^  and 
6^  (kj*£)  are  independent,  and  and  are  independent. 

As  for  the  ability  parameters,  the  specification  of  prior  belief 
about  bj  seems  reasonable,  especially  if  an  item  bank  is  available.  This 
assumption  has  been  made  by  several  authors  (Lord  &  Novick,  1968;  Wright 
&  Douglas,  1977).  Furthermore,  as  a  result  of  the  hierarchical  Bayesian 
model,  departures  from  this  assumption  appear  to  have  a  negligible 
effect  on  the  estimates  of  b^ . 

For  the  second  stage,  we  assume  that 


[25a]  p(ue,<J>0)  «  pCd>0) 


-(ve/2+l) 


exp(-s0v0/2<t>0) , 


[25b]  p(ub,<i>b)  “  P<$b> 

-(Vb/2+1) 


exp(-s2vb/2<|>b>. 


We  have  thus  assumed  that,  apriori,  the  hyperparameters  are  independent, 
and  that  the  prior  information  about  the  parameters,  p0  and  is 


"vague" . 


The  joint  posterior  pdf  of  _0,  and  b^,  is  given  by 


[26]  p(e,b|x,u0,^0,ub,<^b,ve,s2,vb)s2) 


«  h(0.,bjx){  n  p(0^  n  p(b,)}p(4»s)  p(<p.  ) 

i-1  1  j=l  3 

wh  <re  L(j},bjx)  is  the  likelihood  function  given  by  [8],  Now 
N  -(N+v„+2)/2 

[27]  {  n  p(6i)>  p(d>0>  *  i P  exp(-v0s2/24>0)  exp{-(01-p0) 2/2(j>0} 
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Upon  Integrating  with  respect  to  and  v0,  we  have,  from  [17] 

[28]  /  /^  {  n  pCfifH  p((j>6)dwe  d4»e 

-  [»..!♦  f  (e1-.)*r(1,*'«rw«. 

i-1  1 


Similarly, 


[29]  I,*  S0  {jSj  p(bj) 1  d,b 

*  [Vbs2  +  l  (bj  -  b  )!]-^-1^2 

Combining  [26],  [28]  and  [29],  we  obtain  the  joint  posterior  density  of 
0  and  b: 


[30]  P<0.bjx,v0,s2,vb,s2) 

-  [{exp(  J  r±e  »{v0«J  +  f  ce^e  )2)'(N+Ve_1)/2] 

i-1  i-1 

•  [{exp (-  l  qjb^)Kvbs2  +  £  (bj-b  )}  ~(n+vb_1)/2] 


•  [  n  n  {1  +  exp(0  -b  )}] 

i-1  j-1  3 


The  quantity  given  as  L(j^,bJ  x)  , 


exp(^ri6i)  exp(^qjbj) /n  iHl+exp^-bj)  }  *  II  II  expCe^b^) /{l+expCe^b^) } , 

and,  hence,  is  bounded.  In  fact, 

|L(e,b|x)j  s  l  . 


Therefore,  it  follows  that 
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N  -(N+vq-1)/2 

/  |p(±,b)|...)  |d9db  <  / [v08q  +  l  (0J-6  )2]  d6 

i-1 

.  ,  n  -(n+vb-l)/2 

*/lvhsb  +  l  (bi-b  )2]  db 

1*1 


The  Integrals  on  the  right  of  the  inequality  clearly  exist  since  the  kernels 
are  those  of  multivariate  t  densities.  Hence,  the  posterior  pdf, 
P^»b.|*»ve*s0»vb*sb^  ♦  *8  a  Pr°per  pdf  although  the  normalizing  constant 
cannot  be  evaluated  explicitly. 

The  joint  posterior  modes  may  be  taken  as  estimates  of  0^  and  b^ 

(i-1,  ...»  N;  j-1,  ...»  n) .  These  are  obtained  by  setting  equal  to  zero 
the  derivatives  of  log  p(0 ,b| . . . ) ,  and  solving  the  resulting  equations: 


[31] 

n 

£  P« 

*  ri  -  <0i-e.)/°e 

(i-1. 

....  N), 

[32] 

N 

1  ?ij 
i-1  J 

-  qj  +  (bj-b)/a2 

(J-1. 

. . . ,  n)  , 

where 

Pjj  =»  expCej-bjj/d  +  exp(e^-bj)}  , 


r‘  ’  l  ■ 

"]  '  |  xlj  • 

al  “  {ve8e  +  l  <ei“e.>2}/(ve'HI"1)  * 

and 


Since  the  systems  of  equations  is  non-linear,  the  Nevton-Raphson  procedure 
is  employed  to  solve  the  equations  iteratively.  In  order  to  accomplish 
this,  we  let 


[33]  £<»!> 


I  PtJ  +  (0^8  _  )/c|  -  r. 


and 


N 


[34]  hCbj)  - 
Then 


Pij  -  <b;fb.>/ob  -  1J 


[35]  £' (0j) 


Pijd-Pij)  +  ^e(1  -  |>  -  2(0^9  )/(v6+W-l)}/(a§)2  , 


and 


[36]  h'Ojj) 


-  f  Pij<1~Pij)  "  {ob(1  '  n>  *  2(bj-b  )/(vb+n-l))/(ab)2 


As  before,  if  0^)  and  b|^  denote  the  values  of  0^  and  bj  at  the  kth 
iteration,  then 

[37]  o{k+1)  -  0^k)  -  f(ejk))/f(0^k))  , 


and 


[38]  b 


(k+1)  ,<k)  K/K(k)(k) 

j  *  bj  h(bj  )/h ’(bj  ) 


Starting  with  initial  values  6^°^  (i*l,  ...»  N) ,  and  bj  \j«l,  ...»  n) , 
where  0^°^  is  given  by  [23],  and 


j 


log  [(N-q±) /qi] 


0_  is  estimated.  These  values  of  6^  are  then  used  to  obtain  revised  estimates 
of  b.  This  process  is  repeated  with  the  revised  estimates  of  b  being  used 
to  obtain  revised  estimates  of  6_.  The  process  is  terminated  when  the 
convergence  criterion  is  reached.  This  procedure  is  not  the  full  Newton- 
Raphson  procedure  and,  in  this  case,  is  preferred  to  the  full  Newton- 
Raphson  procedure  since  the  latter  requires  obtaining  an  inverse  of  the 
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matrix  of  second  derivatives  at  each  stage  of  the  iteration.  In  practice, 
the  procedure  outlined  here  converges  rather  rapidly. 

As  pointed  out  earlier,  although  the  equations  provided  are  for 
estimating  0^(i-l,  ...,  N) ,  only  @r(r-l,  ...,  n-1)  need  be  estimated. 

In  order  to  carry  this  out,  the  quantities  given  in  Equations  [34]  and 
[35]  have  to  be  computed  as  follows: 


N 

l 


i«l 


1  T  NrP(0r) 

r«l 


N  n-1 

I  Pi1(1“Pij)  ^  l  Nr  P.(0  >{1-P. (©  )} 
i-1  J  J  r-1  3  r  J 


where  denotes  the  number  of  examinees  who  obtained  raw  score  r  and 
Pj(0r)  -  expCOj.-bj)/  {1  +  exp(er-bj)}  . 


Large  Sample  Properties  of  the  Posterior  Distribution 
The  posterior  pdf,  p(£,b| vQ >Vjj,s|,Sk,x) ,  given  by  Equation  [30]  is 
a  product  of  the  likelihood  function  and  a  multivariate  "double-t" 
distribution.  The  "double-t"  distribution  is  a  product  of  two  multi¬ 
variate  t  densities  (Tiao  &  Zellner,  1964;  Zellner,  1971,  p.  101).  As 
a  result  of  its  complex  form,  properties  of  the  posterior  pdf  cannot  be 
obtained.  However,  it  is  possible  to  obtain  the  asymptotic  properties 
of  the  posterior  pdf,  and  this  will  suffice,  in  most  cases,  for  inferences 
to  be  drawn  regarding  the  parameters. 

Let  t  be  a  vector  of  parameters,  and  £  a  vector  of  observations. 
Then,  the  posterior  pdf  of  t.,  p(t.|x)* 
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p(t|z)  *  p(t)  L(ill) 

where  p(t)  is  the  prior  distribution  of  t  and  L(^r|0,  the  likelihood 
function.  Then,  for  large  samples, 

[39]  p(t|z)  “  L<zll)  ♦ 

and,  in  turn,  L(yi  t)  is  approximately  multivariate  normal  centered  at 
the  maximum  likelihood  estimate,  with  dispersion  matrix 

[40]  E  -  [-32log  L(zJt)/3ti3t;J]‘i£ 

Thus,  for  large  samples, 

tj£  ~  N (t_,  Et_-)  . 

For  a  detailed  discussion  of  this  result  we  refer  the  reader  to  Jeffreys 
(1961,  p.  193)  and  Zellner  (1971,  p.  32). 

This  result  clearly  applies  in  the  present  situation  when  both  n 
and  N,  the  number  of  items  and  the  number  of  examinees,  are  large. 
Denoting  the  [  (n+tf)xl]  vector  [0.,b]  as 

t'  -  [e»  b’]  , 

[41]  t|x  *  N(t,  E)  . 

In  order  to  evaluate  E,  we  write 

-1 

where 


[42] 


'0b 


Jb0 


-20- 


[43]  g6  -  {- 32iog  l(x  [e.y/ae^aaji} 


S.-& 


{  ^  P^J<1-Pmj>}  6*m 


where  6^  is  the  Kronecker  delta, 


[44]  Gb  -  {-a2log  L(x j_6,b)/ab^abm}  ^ 

bfb 

N 

=  {  l  pU<l-pim>>  v* 

i»l 


and 


[45]  G0b  -  {-32log  LCxjl.y/aeiabj} 


■  Pij(1_Pij> 

Thus,  the  marginal  distribution  of  0^  has  mean  6^,  the  maximum  likelihood 

estimate  of  0.,  and  variance,  a2  ,  given  by  the  ith  diagonal  element  of 
i 

z,  i«e., 

[46]  „!  -  [08  -  Geb  Gj1  Gb9]-J  . 

Similarly,  the  marginal  distribution  of  bj  has  mean  bj ,  the  maximum  like- 

2 

lihood  estimate  of  b^,  and  variance,  o^,  given  the  jth  diagnonal  element 
of  2,  i.e.. 


[47]  0bj  •  I<T,  -  ®be  Gi1 


Thus, 
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,  n  -(v  +n-l)/2  ,  N  _(v6+N-1)/2 

[50]  [vs*  +  l  (b  -b  )2]  [vqSq  +  l  (0,-8  )2] 

j-1  2  *  1-1 

*  exp  {-  y  (i'A^Q.  +  b.'  A??b) 

[51]  *  exp  {-  j  t/  A  _t> 
where 

t'  -  [  e*  b*  ]  , 

and 

A  *  An  0 

0  A22 

Combining  [41]  and  [51],  we  have 

[52]  P<i»b|x,ve,vb,SQ,s£) 

[53]  «  exp  -  y  {  (t-t)  '  E  (t-t)  +  Jt '  A  t) 

[54]  -  exp{-  j  (t.  “  t) '  T  (t  -  t)} 
where 

[55]  T  -  E  +  A 

and 

[56]  t  -  (E+A)-1  (E_t)* 

♦This  result  follows  from  the  fact  that 

(x-a)’A (x-j»)  +  (x-b/BCx-b)  ■  (x-t)  ’T(x-t)  +  constant, 

where 

T  -  A+B, 


and 


t  -  (A+B)-1  (Aa  +  Bb)  . 
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If  Che  off  diagonal  matrix  G0b  in  [42]  can  be  ignored,  then 


[57]  o 


6.  ”  [  ^  P^d-Pij)]-1  +  (N-I)(ke+1)/Nkese 


and 


[58]  a?  =■  [  l  P^.a-P.,)]-1  +  (n-l)(kh+l)/nkbs? 

j  i=l  XJ 


The  expression  [57]  is  useful  when  the  item  parameters  are  considered 
known.  Similarly,  [58]  is  applicable  when  the  ability  parameters  are 
known.  In  general,  however,  when  the  item  and  ability  parameters  are 
estimated  simultaneously,  the  off  diagonal  matrix,  Ggb,  cannot  be 
ignored,  and  hence,  in  this  case,  the  complete  expression  given  by  either 
[46]  or  [55]  should  be  employed.  With  these  results  it  is  possible  to 
construct  "credibility  intervals"  (Novick  &  Jackson,  1974)  for  the 
parameters  of  interest. 


COMPARISON  STUDIES 

In  order  to  study  the  efficacy  of  the  Bayesian  procedure  described 
above  and  to  compare  the  Bayesian  estimates  with  the  maximum  likelihood 
estimates,  a  simulation  study  was  carried  out.  Although  simulation  studies 
may  not  be  realistic  in  some  situations,  they  can  be  justified  in  the 
present  context  since  only  through  a  simulation  study  can  one  estimation 
procedure  be  compared  with  another. 

Artificial  data,  representing  the  responses  of  N  individuals  on  n 
items,  were  generated  using  DATGEN  (Hambleton  &  Rovinelli,  1973)  accord¬ 
ing  to  the  one-parameter  logistic  model.  In  generating  the  values  of 


0^  and  bj  (i-1,  N;  j«l,  . ..,  n) ,  it  was  assumed  that  0^  and  bj  were 

independently  and  identically  normally  distributed  with  mean,  zero,  and 
variance,  unity  (we  shall  return  to  a  discussion  of  this  issue  later). 

The  design  of  the  comparison  study  was  conceptualized  in  terms  of  the 
following,  completely  crossed,  factors:  estimation  procedure  (Bayesian, 
maximum  likelihood);  number  of  examinees,  N  (20,  50);  number  of  items, 
n  (15,  25,  40,  50).  This  design  was  carried  out  for  (i)  conditional 
estimation  of  6^  and,  (ii)  joint  estimation  of  6^  and  ]>. 

The  size  of  the  examinee  population,  N,  and  the  test  length,  n, 
were  chosen  to  facilitate  comparison  of  the  maximum  likelihood  and  the 
Bayesian  estimates  for  small  sample  sizes  and  short  tests,  since  the  large 
sample  behavior  of  the  maximum  likelihood  estimates  has  been  studied  by 
Swaminathan  and  Gifford  (1979) .  These  authors  have  found  that  maximum 
likelihood  estimates  of  0j_  and  bj  approach  the  true  values  for  N  as  large 
as  200  and  n  as  large  as  100.  Since  for  these  values  of  N  and  n,  Bayesian 
estimates  can  be  expected  to  be  the  same  as  maximum  likelihood  estimates, 
the  study  was  focused  on  small  values  of  N  and  n. 

The  Bayesian  estimates  and  the  maximum  likelihood  estimates  were 
compared  with  respect  to  accuracy.  The  two  sets  of  estimates  were  com¬ 
pared  with  respect  to:  (a)  the  mean  value  of  the  estimates,  as  compared 
with  the  mean  value  of  the  true  values;  (b)  the  mean  squared  error 
difference  between  the  true  values  and  the  estimated  values;  and,  (c)  the 
regression  of  the  true  value  on  the  estimated  value. 

It  may  be  argued  that  since  the  joint  modes  of  the  posterior  distri¬ 
bution  were  taken  as  estimates  of  the  parameters,  the  criterion  employed 
to  determine  the  accuracy  of  the  estimates  is  incompatible  with  the  loss 


function  employed  to  arrive  at  the  estimates.  This  is  a  valid  argument. 
However,  we  are  primarily  interested  in  comparing  the  Bayesian  estimates 
with  the  maximum  likelihood  estimates.  Since,  in  one  sense,  the  maximum 
likelihood  estimates  can  be  thought  of  as  the  modes  of  the  posterior 
distribution  derived  under  the  assumption  that  the  prior  information  is 
vague,  comparison  of  two  modal  estimates  using  a  different  criterion 
other  than  that  involved  in  deriving  the  estimates  may  be  justifiable; 
particularly  since  this  will  not  provide  an  "unfair"  advantage  to  one 
set  of  estimates. 

Comparison  of  the  two  estimation  procedures  in  terms  of  the  regres¬ 
sion  of  true  values  on  the  estimates  needs  some  explanation.  If  t  is 
the  true  value  of  the  parameter  and  E,  the  estimate,  then  E(T  |E*e)  ■  $Q+8^e. 
If  and  6j_al,  then,  it  can  be  concluded  that  the  estimates  are  unbiased, 

and  hence,  the  departure  from  the  expected  values  of  8Q  and  8^  can  be 
taken  as  an  indicator  of  bias.  It  should  be  pointed  out  here  that  the 
classical  notion  of  bias  is  not  critical  in  Bayesian  analyses.  Neverthe¬ 
less,  comparison  of  the  regression  lines  will  provide  a  further  assessment 
of  the  accuracy  of  the  two  procedures. 

The  comparison  of  the  maximum  likelihood  (ML)  procedure  and  the 
Bayesian  procedure  for  the  conditional  estimation  of  ability  6  is  provided 
in  Table  1.  The  first  column  contains  the  means  of  the  true  values  of  0, 
the  ML  estimates,  and  the  Bayesian  estimates.  The  second  column  provides 
an  assessment  of  accuracy  in  terms  of  the  mean  squared  deviation  between 
the  estimate  6  and  the  true  value,  0^.  The  correlations  between  0t  and 
6  for  each  estimation  procedure  is  displayed  in  column  four,  while  the 
regression  of  0  on  §  is  given  in  column  five. 
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An  examination  of  the  correlations  between  the  true  values  and  esti¬ 
mates  reveals  that,  in  general,  the  difference  between  ML  and  Bayes 
estimates,  is  negligible  for  relatively  large  values  of  N  and  n.  However, 
for  small  values  of  N  and/or  n,  the  Bayes  estimates  correlate  better 
with  true  values  than  the  ML  estimates. 

The  correlation  coefficient,  by  itself,  is  not  a  sufficient 
indicator  of  the  accuracy  of  estimation.  Clear  differences  between  the 
Bayesian  and  ML  procedures  emerge  when  we  examine  the  other  criteria. 

In  general,  the  means  of  the  Bayesian  estimates,  in  comparison  with 
the  ML  estimates,  are  closer  to  the  means  of  the  true  values.  This  result 
can  be  anticipated  if  we  examine  the  estimating  equations  [19].  The 
estimating  equations  for  ML  estimates  are: 
n 


l 

j-1 


Pij 


ri 


(i-1,  ....  N). 


The  additional  term  in  the  Bayesian  estimating  equations,  (6^6 .) /a2 
contributes  to  the  regression  of  the  estimates  towards  the  mean,  and 
hence,  the  Bayesian  estimates  are  closer  to  the  means  of  the  true  values. 
The  only  exception  occurs  with  N*20  and  n»15,  25.  At  this  point,  there 
is  no  explanation  for  this  anomolous  result.  Further  replications  are 
clearly  necessary  to  establish  this  point  conclusively. 

The  most  dramatic  difference  between  the  Bayesian  estimates  and  the 
ML  estimates  is  with  respect  to  the  mean  squared  deviations  of  the  esti¬ 
mates  from  the  true  values.  In  general,  the  mean  squared  deviations  are 
much  smaller  for  the  Bayesian  estimates  than  for  the  ML  estimates.  The 
difference  is  particularly  noticable  with  small  N  and  n.  In  these  cases, 
the  mean  squared  deviations  for  the  ML  estimates  is  almost  four  times  as 


large  as  that  for  the  Bayesian  estimates.  This  finding  can  again  be 
explained  by  the  fact  prior  information  is  most  helpful  in  these  cases. 

This,  together  with  the  regression  effect  described  previously,  results 
in  an  increase  in  the  accuracy  of  the  estimation  procedure. 

An  examination  of  the  regressions  of  true  values  on  estimated 
vlues  also  provides  some  interesting  results.  In  general,  the  intercepts 
and  the  slopes  of  the  Bayesian  regressions  are  closer  to  zero  and  one 
respectively,  than  the  ML  regressions.  The  trend  for  the  intercepts  is 
reversed  for  large  n.  In  these  cases,  the  intercepts  for  the  ML  regressions 
are  closer  to  zero  than  the  intercepts  for  the  Bayesian  regressions.  This 
latter  result  is  interpretable,  since  the  maximum  likelihood  estimates  of 
6,  for  large  N  and  n,  approach  the  true  values.  However,  the  trend  for 
small  n  and  N  is  rather  surprising  since,  as  a  result  of  regression  towards 
the  mean,  the  Bayesian  estimates  can  be  expected  to  be  "biased."  The  only 
explanation  for  this  finding  is  that  the  ML  procedure  is  severely  biased 
for  small  n  and  N,  even  more  so  than  the  Bayesian  procedure. 

The  above  findings,  for  conditional  estimation  of  6,  appear  to  be 
valid  for  the  joint  estimation  of  and  b  (Tables  2  and  3).  In  fact,  the 
results  for  the  joint  estimation  of  ^  and  b  favor  the  Bayesian  estimates 
on  all  counts  for  both  6^  and  b:  the  means  of  the  estimates  are  closer 

to  the  means  of  the  true  values;  the  mean  squared  deviations  are  much 
smaller  (in  some  cases,  one-tenth  the  size  of  those  for  ML  estimates); 
the  slopes  and  intercepts  are  closer  to  one  and  zero  respectively  (the 
only  exception  occurs  for  large  N  and  n,  in  which  case,  the  intercepts 
of  the  ML  regression  are  closer  to  zero) . 
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DISCUSSION 

The  Bayesian  procedure  for  estimating  parameters  in  the  one-parameter 
latent  trait  model  is  an  attractive  alternative  to  the  maximum  likelihood 
procedure.  Bayesian  procedures  are  conceptually  more  appealing  since 
direct  interpretations  of  probability  statements  involving  the  parameters 
are  possible.  Empirically,  as  the  results  of  the  comparison  study  indi¬ 
cate,  the  Bayesian  estimates  of  the  parameters  are  superior  to  the  maximum 
likelihood  estimates  in  terms  of  their  accuracy. 

Although  the  empirical  results  demonstrate  the  effectiveness  of  the 
Bayesian  procedure,  it  may  be  argued,  and  correctly,  that  the  simulation  of 
the  data  favored  the  Bayesian  procedure.  The  data  were  generated  to  meet 
the  strong  distributional  assumptions  required  by  the  Bayesian  procedure. 

In  addition,  in  specifying  prior  belief  about  the  distribution  4>q  and  4>b> 
s|  and  s£  were  set  equal  to  one  with  the  corresponding  vQ  and  vb  being 
specified  as  15.  In  the  simulation  and  $b  were  set  at  one,  and  the 
specification  of  sg,  s£  and  the  relatively  large  values  for  v0  and  vb 
reproduced  the  true  state  of  affairs.  It  is  not  surprising,  therefore, 
that  the  Bayesian  procedure  proved  to  be  superior  to  the  maximum  likeli¬ 
hood  procedure . 

In  fairness  to  the  study,  it  should  be  pointed  out  that  the  simula¬ 
tion  and  the  accurate  specification  of  prior  belief  were  deliberate  in 
order  to  determine  the  applicability  of  the  Bayesian  procedure,  at  least,  under 
ideal  conditions.  Preliminary  investigations  with  non-normal  data  and 
also  with  poor  specification  of  priors  indicate  that  the  Bayesian  proce¬ 
dure,  being  based  on  a  hierarchical  model,  is  relatively  robust  and  is 
superior  to  the  maximum  likelihood  procedure.  A  detailed  study  of  the 
effects  of  poor  specification  of  priors  and  departures  from  underlying 
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assumptions  is  currently  under  way  and  we  expect  to  report  these  results 
in  the  near  future. 

Despite  the  encouraging  results  obtained,  a  theoretical  problem 
still  remains  with  the  estimation  procedure.  The  procedure  described  in 
this  paper  requires  the  joint  estimation  of  n  structural  parameters  and 
N  incidental  parameters.  If  N-*»  while  n  remains  fixed,  the  joint  posterior 
pdf  may  not  become  concentrated  about  the  estimated  values.  This  trend 
is  evident  from  Tables  2  and  3;  with  increasing  N,  the  intercept  and 
slope  do  not  tend  to  zero  and  one  respectively.  This  problem  is  similar 
to  the  one  that  exists  with  maximum  likelihood  estimates.  Although 
from  a  Bayesian  point  of  view  asymptotic  properties,  such  as  consistency, 
are  not  critical,  the  lack  of  them,  at  least  to  some  degree,  is  discom¬ 
forting.  It  appears  that  this  situation  can  be  remedied,  if  when  esti¬ 
mating  the  n  structural,  or  item,  parameters,  the  ability  parameters 
are  considered  nuisance  parameters  and  can  be  integrated  out  to  yield  the 
marginal  posterior  pdf  of  b.  The  marginal  posterior  pdf  is  currently 
not  available  as  a  result  of  the  exceedingly  complex  form  of  the  joint 
posterior  pdf.  Approximations,  such  as  the  one  indicated  (Equation  [15]) 
may  be  employed  to  simplify  the  joint  posterior  pdf.  Initial  investiga¬ 
tions  reveal  that  this  approximation  is  reasonably  good,  but  further 
research  in  this  area  is  clearly  needed. 

In  summary,  we  note  that  the  Bayesian  procedure  developed  in  this 
paper  is  relatively  simple  to  implement,  and  computationally  as  efficient 
as  the  maximum  likelihood  procedure.  Despite  the  Issues  raised  above, 
the  Bayesian  procedure  has  the  potential  for  greatly  improving  the  accuracy 
of  the  estimates.  Moreover,  the  maximum  improvement  in  accuracy  occurs 


for  small  values  of  N  and  n,  a  result  that  can  be  expected,  and  this 
makes  the  Bayesian  procedure  more  attractive  than  the  maximum  likelihood 
procedure. 
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Navy  Recruiting  Command 
4015  Wilson  Boulevard 
Arlington,  VA  22203 

1  Dr,  Bernard  Rimland  (03B) 

Navy  Personnel  R&D  Center 
San  Diego,  CA  92152 

1  Mr.  Arnold  Rubenstein 

Naval  Personnel  Support  Technology 
Naval  Material  Command  (08T244) 

Room  104H,  Crystal  Plaza  H5 
2221  Jefferson  Davis  Highway 
Arlington,  VA  20360 

1  Dr.  Worth  Scanland 

Chief  of  Naval  Education  and  Training 
Code  N-5 

NAS,  Pensacola,  FL  32508 
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Navy 


1  Dr.  Robert  G.  Smith 

Office  of  Chief  of  Naval  Operations 
0P-987H 

Washington,  DC  20350 

1  Dr.  Alfred  F.  Smode 

Training  Analysis  &  Evaluation  Group 
(TAEG) 

Dept,  of  the  Navy 
Orlando,  FL  32813 

1  Dr.  Richard  Sorensen 

Navy  Personnel  RAD  Center 
San  Diego.  CA  92152 

1  W.  Gary  Thomson 

Naval  Ocean  Systems  Center 
Code  7132 

San  Diego,  CA  92152 

1  Dr .  Ronald  Weitzman 
Code  54  WZ 

Department  of  Administrative  Sciences 
U.  S.  Naval  Postgraduate  School 
Monterey,  CA  93940 

1  DR.  MARTIN  F.  WISKOFF 

NAVY  PERSONNEL  RA  D  CENTER 
SAN  DIEGO,  CA  92152 

1  Mr  John  H.  Wolfe 
Code  P310 

U.  S.  Navy  Personnel  Research  and 
Development  Center 
San  Diego,  CA  92152 


Army 


1  Technical  Director 

U.  S.  Army  Research  Institute  for  the 
Behavioral  and  Social  Sciences 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

1  HQ  USAREUE  A  7th  Army 
0DCS0PS 

USAAREUE  Director  of  GED 
APO  New  York  09403 

1  DR.  RALPH  DUSEK 

U.S.  ARMY  RESEARCH  INSTITUTE 
5001  EISENHOWER  AVENUE 
ALEXANDRIA,  VA  22333 

1  Dr.  Myron  Fisc hi 

U.S.  Army  Research  Institute  for  the 
Social  and  Behavioral  Sciences 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

1  Dr.  Michael  Kaplan 

U.S.  ARMY  RESEARCH  INSTITUTE 
5001  EISENHOWER  AVENUE 
ALEXANDRIA,  VA  22333 

1  Dr.  Milton  S.  Katz 

Training  Technical  Area 
U.S.  Army  Research  Institute 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

1  Dr.  Harold  F.  O'Neil,  Jr. 

Attn:  PERI-OK 
Army  Research  Institute 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

1  DR.  JAMES  L.  RANEY 

U.S.  ARMY  RESEARCH  INSTITUTE 
5001  EISENHOWER  AVENUE 
ALEXANDRIA,  VA  22333 

1  Mr.  Robert  Ross 

U.S.  Army  Research  Institute  for  the 
Social  and  Behavioral  Sciences 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 
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Army 


Dr .  Robert  Sasmor 

U.  S.  Army  Research  Institute  for  the 
Behavioral  and  Social  Sciences 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

Commandant 

US  Army  Institute  of  Administration 
Attn:  Dr.  Sherrill 
FT  Benjamin  Harrison,  IN  46256 

Dr.  Frederick  Steinheiser 
0.  S.  Army  Reserch  Institute 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

Dr .  Joseph  Ward 
U.S.  Army  Research  Institute 
5001  Eisenhower  Avenue 
Alexandria ,  VA  22333 


Air  Force 


1  Air  Force  Human  Resources  Lab 
AFHRL/MPD 

Brooks  AFB,  TX  78235 

1  U.S.  Air  Force  Office  of  Scientific 
Research 

Life  Sciences  Directorate,  NL 
Bolling  Air  Force  Base 
Washington,  DC  2033 2 

1  Air  University  Library 
AUL/LSE  76/443 
Maxwell  AFB,  AL  36112 

1  Dr.  Earl  A.  Alluisi 
HQ,  AFHRL  (AFSC) 

Brooks  AFB,  TX  78235 

1  Dr.  Genevieve  Haddad 
Program  Manager 
Life  Sciences  Directorate 
AF0SR 

Bolling  AFB,  DC  2033 2 

1  Dr.  Ross  L.  Morgan  ( AFHRL/LR) 

Wright  -Patterson  AFB 
Ohio  45433 

1  Research  and  Measurment  Division 
Research  Branch,  AFMPC/MPCYPR 
Randolph  AFB,  TX  78148 

1  Dr .  Malcolm  Ree 
AFHRL/MP 

Brooks  AFB,  TX  78235 

1  Dr.  Marty  Rockway  ( AFHRL/TT) 

Lowry  AFB 
Colorado  80230 

1  Dr.  Frank  Schufletowski 
U.S.  Air  Force 
ATC/XPTD 

Randolph  AFB,  TX  78148 


1  Jack  A.  Thorpe,  Maj.,  USAF 
Naval  War  College 
Providence,  RI  02846 
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Air  Force  Marines 


1  Dr.  Joe  Ward,  Jr.  1  H.  Uilliam  Greenup 

AFHRL/f'PMD  Education  Advisor  (E03D 

Brooks  AFB,  TX  78235  Education  Center,  MCDEC 

Quantico,  VA  22 131* 

1  Director,  Office  of  Manpower  Utilization 
HQ,  Marine  Corps  (MPU) 

BCB,  Bldg.  2009 
Quantico,  VA  221 3« 

1  Headquarters,  U.  S.  Marine  Corps 
Code  MPI-20 
Washington,  DC  20380 

1  Major  Michael  L.  Pa trow,  USMC 
Headquarters,  Marine  Corps 
(Code  MPI-20) 

Washington,  DC  20380 

1  DR.  A.L.  SLAFKOSKY 

SCIENTIFIC  ADVISOR  (CODE  RD-1) 

HQ,  U.S.  MARINE  CORPS 
WASHINGTON,  DC  20380 
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CoastGuard 


Chief,  Psychological  Reserch  Branch  12 

U.  S.  Coast  Guard  (G-P-1/2/TP42) 

Washington,  DC  20593 

Hr.  Thomas  A.  Warm 

U.  S.  Coast  Guard  Institute  1 

P.  0.  Substation  18 
Oklahoma  City,  OK  73169 


1 


1 


1 


Other  DoD 


Defense  Documentation  Center 
Cameron  Station,  Bldg.  5 
Alexandria,  VA  22314 
Attn :  TC 

Dr.  Dexter  Fletcher 

ADVANCED  RESEARCH  PROJECTS  AGENCY 

1400  WILSON  BLVD. 

ARLINGTON,  VA  22209 

Dr.  William  Graham 
Testing  Directorate 
MEPCCM/MEPCT-P 
Ft.  Sheridan,  IL  60037 

Director,  Research  and  Data 
OASDCKRA&L) 

3B919,  The  Pentagon 
Washington,  DC  20301 

Military  Assistant  for  Training  and 
Personnel  Technology 

Office  of  the  Under  Secretary  of  Defense 
for  Research  &  Engineering 
Room  3D  129,  The  Pentagon 
Washington,  DC  20301 

MAJOR  Wayne  Sellman,  USAF 
Office  of  the  Assistant  Secretary 
of  Defense  (MRA&L) 

3B930  The  Pentagon 
Washington,  DC  20301 
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Civil  Govt 


1  Dr.  Susan  Chipman 

Learning  and  Development 
National  Institute  of  Education 
1200  19th  Street  NW 
Washington,  PC  20208 

1  Dr.  Lorraine  D.  Eyde 
Personnel  R&D  Center 
Office  of  Personnel  Management  of  USA 
1900  EStreet  NW 
Washington,  D.C.  20415 

1  Jerry  Lehnus 

REGIONAL  PSYCHOLOGIST 

U.S.  Office  of  Personnel  Management 

230  S.  DEARBORN  STREET 

CHICAGO,  IL  60604 

1  Dr.  Andrew  P.  Molnar 
Science  Education  Dev. 
and  Research 

National  Science  Foundation 
Washington,  DC  20550 

1  Personnel  RAP  Center 

Office  of  Personnel  Managment 
1900  E  Street  NW 
Washington,  DC  20415 

1  Dr.  H.  Wallace  Sinaiko 
Program  Director 

Manpower  Research  and  Advisory  Services 
Smithsonian  Institution 
301  North  Pitt  Street 
Alexandria,  VA  22314 

1  Dr .  Vern  W.  Urry 

Personnel  R&D  Center 
Office  of  Personnel  Management 
1900  E  Street  NW 
Washington,  DC  20415 

1  Dr.  Joseph  L.  Young,  Director 
Memory  1  Cognitive  Processes 
National  Science  Foundation 
Washington,  DC  20550 


Non  Govt 


1  Dr.  Erling  B.  Andersen 
Department  of  Statistics 
Studiestraede  5 
1455  Copenhagen 
DENMARK 

1  1  psychological  research  unit 

Dept,  of  Defense  (Army  Office) 
Campbell  Park  Offices 
Canberra  ACT  2600,  Australia 

1  Dr.  Alan  Baddeley 

Medical  Research  Council 

Applied  Psychology  Unit 
15  Chaucer  Road 
Cambridge  CB2  2EF 
ENGLAND 

1  Dr.  Isaac  Be jar 

Educational  Testing  Service 
Princeton,  NJ  03450 

1  Dr.  Werner  Birke 

DezWPs  im  Streitkraefteamt 
Postfach  20  50  03 
D-5300  Bonn  2 
WEST  GERMANY 

1  Dr.  R.  Darrel  Bock 

Department  of  Education 
University  of  Chicago 
Chicago,  IL  60637 

1  Dr.  Nicholas  A.  Bond 
Dept,  of  Psychology 
Sacramento  State  College 
600  Jay  Street 
Sacramento,  CA  95819 

1  Dr.  Robert  Brennan 

American  College  Testing  Programs 

P.  0.  Box  168 

Iowa  City,  IA  52240 

1  DR.  C.  VICTOR  BUNDERSON 
WICAT  INC. 

UNIVERSITY  PLAZA,  SUITE  10 
1160  SO.  STATE  ST. 

OREM,  UT  84057 


w 
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Non  Gov  t 

Non  Govt 

■ 

1 

Dr.  John  R.  Carroll 

1 

Dr.  A.  J.  Eschenbrenner 

Psychometric  Lab 

Dept.  E422,  Bldg.  81 

Univ.  of  No.  Carolina 

McDonnell  Douglas  Astronautics  Co. 

Davie  Hall  013A 

P.O.Box  516 

Chapel  Hill,  NC  275 14 

St.  Louis,  M0  63166 

1 

Charles  Myers  Library 

1 

Dr.  Leonard  Feldt 

Livingstone  House 

Lindquist  Center  for  Measurment 

Livingstone  Road 

University  of  Iowa 

Stratford 

Iowa  City,  IA  52242 

London  E 15  2LJ 

ENGLAND 

1 

Dr.  Richard  L.  Ferguson 

The  American  College  Testing  Program 

1 

Dr.  Kenneth  E.  Clark 

P.0.  Box  168 

f 

College  of  Arts  4  Sciences 

University  of  Rochester 

Iowa  City,  IA  52240 

River  Campus  Station 

1 

Dr.  Victor  Fields 

Rochester ,  NY  14527 

Dept,  of  Psychology 

Montgomery  College 

1 

Dr.  Norman  Cliff 

Dept,  of  Psychology 

Rockville,  MD  20850 

Univ.  of  So.  California 

1 

Univ.  Prof.  Dr.  Gerhard  Fischer 

University  Park 

Liebiggasse  5/3 

Los  Angeles,  CA  90007 

A  1010  Vienna 

AUSTRIA 

* 

1 

Dr.  William  E.  Coffhian 

Director,  Iowa  Testing  Programs 

1 

Professor  Donald  Fitzgerald 

i 

334  Lindquist  Center 

University  of  New  England 

| 

University  of  Iowa 

Armidale,  New  South  Wales  2351 

t 

Iowa  City,  IA  52242 

AUSTRALIA 

!  ! 

Dr.  Meredith  P.  Crawford 

1 

Dr.  Edwin  A.  Fleishman 

! 

American  Psychological  Association 

Advanced  Research  Resources  Organ. 

1200  17th  Street,  N.W. 

Suite  900 

f 

Washington,  DC  20036 

4330  East  West  Highway 

Washington,  DC  20014 

! 

! 

i 

Dr.  Hans  Crombag 

Education  Research  Center 

1 

Dr.  John  R.  Frederiksen 

l 

University  of  Leyden 

Bolt  Beranek  &  Newnan 

Boerhaavelaan  2 

50  Moulton  Street 

233*1  EM  Leyden 

The  NETHERLANDS 

Cambridge,  MA  02138 

1 

DR.  ROBERT  GLASER 

i 

LC0L  J.  C.  Eggenberger 

LRDC 

DIRECTORATE  OF  PERSONNEL  APPLIED  RESEARC 

UNIVERSITY  OF  PITTSBURGH 

* 

NATIONAL  DEFENCE  HQ 

3939  O’HARA  STREET 

101  COLONEL  BY  DRIVE 

OTTAWA,  CANADA  'CIA  0K2 

PITTSBURGH,  PA  15213 

i 

L _ 

J 
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Non  Govt 


Non  Govt 


1  Dr.  Daniel  Gopher 

Tndustrial  A  Management  Engineering 
Technion-Israel  Institute  of  Technology 
Haifa 
ISRAEL 

1  Dr .  Ron  Hambleton 
School  of  Education 
University  of  Massachusetts 
Amherst,  MA  01002 

1  Dr.  Chester  Harris 
School  of  Education 
University  of  California 
Santa  Barbara,  CA  93106 

1  Glenda  Greenwald,  Ed. 

"Humrn  Intelligence  Newsletter" 

F.  0.  Box  1163 
Firminghan,  MI  48012 

1  Dr .  Lloyd  Humphreys 

Department  of  Psychology 
University  of  Illinois 
Champaign,  IL  61820 

1  Library 

Hum RRO/ Western  Division 
27357  Berwick  Drive 
Carmel,  CA  93921 

1  Dr.  Steven  Hunka 

Department  of  Education 
University  of  Alberta 
Edmonton,  Alberta 
CANADA 

1  Dr .  Earl  Hunt 

Dept,  of  Psychology 
University  of  Washington 
Seattle,  UA  98105 

1  Dr.  Huynh  Huynh 

College  of  Education 
University  of  South  Carolina 
Columbia,  SC  29208 


1  Dr.  Douglas  H.  Jones 
Rm  T-255 

Educational  Testing  Service 
Princeton,  NJ  08350 

3  Journal  Supplement  Abstract  Service 
American  Psychological  Association 
1200  17th  Street  N.W. 

Washington,  DC  20036 

1  Professor  John  A.  Keats 
University  of  Newcastle 
AUSTRALIA  2308 

1  Dr.  Stephen  Kosslyn 
Harvard  University 
Department  of  Psychology 
33  Kirkland  Street 
Cambridge,  MA  02138 

1  Mr.  Marlin  Kroger 
1117  Via  Goleta 

Palos  Verdes  Estates,  CA  90273 

1  Dr.  Alan  Lesgold 
Learning  R&D  Center 
University  of  Pittsburgh 
Pittsburgh,  PA  15260 

1  Dr.  Michael  Levine 

210  Education  Building 
University  of  Illinois 
Champaign,  IL  61820 

1  Dr.  Charles  Lewis 

Faculteit  Sociale  We  tense  happen 
Ri jksuniversiteit  Groningen 
Oude  Boteringestraat 
Groningen 
NETHERLANDS 

1  Dr  .  Robert  Linn 

College  of  Education 
University  of  Illinois 
Urbana,  IL  61801 

1  Dr.  Frederick  M.  Lord 

Educational  Testing  Service 
Princeton,  NJ  08530 
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Non  Govt 


1  Or.  Janies  Lunsden 

Department  of  Psychology 
University  of  Western  Australia 
Ned lands  W.A.  6009 
AUSTRALIA 

1  Dr.  Gary  Marco 

Educational  Testing  Service 
Princeton,  NJ  08450 

1  Dr .  Scott  Maxwell 

Department  of  Psychology 
University  of  Houston 
Houston,  TX  77004 

1  Dr.  Samuel  T.  Mayo 

Loyola  University  of  Chicago 
820  North  Michigan  Avenue 
Chicago,  IL  60611 

1  Dr.  Mark  Miller 

Computer  Science  Laboratory 
Texas  Instruments,  Inc. 

Mail  Station  271,  P.0.  Box  225936 
Dallas,  TX  75265 

1  Professor  Jason  Tillman 
Department  of  Education 
Stone  Hall 
Cornell  University 
Ithaca,  MY  1HR53 

1  Dr.  Allen  Munro 

Behavioral  Technology  Laboratories 
1845  Elena  Ave.,  Fourth  Floor 
Redondo  Beach ,  CA  90277 

1  Dr.  Melvin  P.  Novick 

256  Lindquist.  Center  for  Measurment 
University  of  Iowa 
Iowa  City,  IA  522'i2 

1  Dr.  Jesse  Orlansky 

Institute  for  Defense  Analyses 
400  Army  Navy  Drive 
Arlington,  VA  22:02 


Non  Govt 


1  Dr.  James  A.  Paulson 

Portland  State  University 
P.0.  Box  751 
Portland,  OR  97207 

1  MR.  LUIGI  PETRULL0 

2431  N.  EDGEW00D  STREET 
ARLINGTON,  VA  22207 

1  DR.  DIANE  M.  RAMSEY-KLEE 

R-K  RESEARCH  &  SYSTEM  DESIGN 
3947  RIDGEM0NT  DRIVE 
MALIBU,  CA  90265 

1  M INRAT  M.  L.  RAUCH 
P  II  4 

BUN DESM I N ISTE R IUM  DER  VERTEIDIGUMC 

P0STFACH  1328 

D-53  BONN  1,  GERMANY 

1  Dr.  Mark  D.  Reckase 

Educational  Psychology  Dept. 
University  of  Missour i-Columbia 
4  Hill  Hall 
Columbia,  MO  65211 

1  Dr.  Andrew  M.  Rose 

American  Institutes  for  Research 
1055  Thomas  Jefferson  St.  NW 
Washington,  DC  20007 

1  Dr.  Leonard  L.  Rosenbaun,  Chairman 
Department  of  Psychology 
Montgomery  College 
Rockville,  MD  20850 

1  Dr.  Lawrence  Rudner 
403  Elm  Avenue 
Takoma  Park,  MD  20012 

1  Dr.  J.  Ryan 

Department  of  Education 
University  of  South  Carolina 
Columbia,  SC  29208 

1  PROF.  FUMIK0  SAMEJIMA 
DEPT.  OF  PSYCHOLOGY 
UNIVERSITY  OF  TENNESSEE 
KNOXVILLE,  TN  37916 
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Mon  Govt 


i 


1  DR.  ROBERT  J.  SEIDEL 

INSTRUCTIONAL  TECHNOLOGY  GROUP 
HUM  RRO 

300  N.  WASHINGTON  ST. 

ALEXANDRIA,  VA  22314 

1  Dr.  Kazuo  Shigemasu 
University  of  Tohoku 
Department  of  Educational  Psychology 
Kawauchi,  Sendai  980 
JAPAN 

1  Dr.  Edwin  Shirkey 

Department  of  Psychology 
University  of  Central  Florida 
Orlando,  FL  32816 

1  Dr  .  Richard  Snow 
School  of  Education 
Stanford  University 
Stanford,  CA  <,'4  305 


1  Dr.  Brad  Sympson 

Psychometric  Research  Group 
Educational  Testing  Service 
Princeton,  NJ  08541 

1  Dr.  Kikumi  Tatsuoka 

Computer  Based  Education  Research 
Laboratory 

252  Engineering  Research  Laboratory 
University  of  Illinois 
Urbana,  IL  61801 

1  Dr.  David  Thissen 

Department  of  Psychology 
University  of  Kansas 
Lawrence,  KS  66044 

1  Dr.  J.  Uhlaner 

Perceptronics,  Inc. 

6271  Variel  Avenue 
Woodland  Hills,  CA  91364 


1  Dr .  Kathryn  T.  Bpoehr 
Department  of  Psychology 
Brown  University 
Providence,  RI  02 912 


Dr.  Howard  Wainer 

Bureau  of  Social  SCience  Research 

1990  M  Street,  N.  W. 

Washington,  DC  20036 


1  Dr .  Robert  Sternberg 
Dept,  of  Psychology 
Yale  University 
Pox  11A ,  Yale  Station 
New  Haven,  CT  06520 


1  Dr.  David  J.  Weiss 
N660  Elliott  Hall 
University  of  Minnesota 
75  E.  River  Road 
Minneapolis,  MN  55455 


1  DR.  PATRICK  SUPrSS 

INSTITUTE  FOR  MATHEMATICAL  STUDIES  IN 
THE  SOCIAL  SCIENCES 
STANFORD  UNIVERSITY 
STANFORD,  CA  94305 

1  Dr.  Hariharan  Swjminathan 

Laboratory  of  Psychometric  and 
Evaluation  Research 
School  of  Education 
University  of  Massachusetts 
Amherst,  MA  010C ? 


1  DR.  GERSHON  WELTMAN 
PERCEPTRONICS  INC. 

6271  VARIEL  AVE. 

WOODLAND  HILLS,  CA  91367 

1  DR.  SUSAN  E.  WHITELY 
PSYCHOLOGY  DEPARTMENT 
UNIVERSITY  OF  KANSAS 
LAWRENCE,  KANSAS  66044 

1  Wolfgang  Wildgrube 
Streitkraefteamt 
Box  20  50  03 
D-5300  Bonn  2 
WEST  GERMANY 
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1  Dr.  J.  Arthur  Woodward 
Department  of  Psychology 
University  of  California 


